Skip to content

Conversation

@samxbr
Copy link
Contributor

@samxbr samxbr commented Nov 25, 2025

Handle individual doc parsing failure gracefully in a bulk request with pipeline, to prevent the whole bulk request failing due to a single doc failure.

Closes #138445

@samxbr samxbr added auto-backport Automatically create backport pull requests when merged v9.0.9 v8.18.9 v9.2.2 v8.19.8 v9.1.8 :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP labels Nov 25, 2025
@elasticsearchmachine
Copy link
Collaborator

Hi @samxbr, I've created a changelog YAML for you.

@samxbr samxbr marked this pull request as ready for review November 26, 2025 16:13
@elasticsearchmachine elasticsearchmachine added the Team:Data Management Meta label for data/management team label Nov 26, 2025
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

Copy link
Member

@PeteGillinElastic PeteGillinElastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Just a couple of nits around some mockito syntax to avoid those unchecked conversions.

@samxbr samxbr merged commit 933354b into elastic:main Nov 26, 2025
34 checks passed
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
9.0 Commit could not be cherrypicked due to conflicts
8.18 Commit could not be cherrypicked due to conflicts
9.2
8.19 Commit could not be cherrypicked due to conflicts
9.1 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 138624

@samxbr
Copy link
Contributor Author

samxbr commented Nov 27, 2025

💚 All backports created successfully

Status Branch Result
9.1
9.0
8.19
8.18

Questions ?

Please refer to the Backport tool documentation

samxbr added a commit to samxbr/elasticsearch that referenced this pull request Nov 27, 2025
@samxbr
Copy link
Contributor Author

samxbr commented Nov 27, 2025

Not backporting to 8.18 and 9.0 as they are no longer maintained. The bug fix will be backported to 8.19, 9.1 and 9.2

elasticsearchmachine pushed a commit that referenced this pull request Nov 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged backport pending >bug :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP Team:Data Management Meta label for data/management team v8.19.8 v9.1.8 v9.2.2 v9.3.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

The entire bulk request fails if any document parsing fails with pipeline configured

3 participants